Continuous Performance Evaluation for Business Process Outcome Monitoring

While a few approaches to online predictive monitoring have focused on concept drift model adaptation, none have considered in depth the issue of performance evaluation for online process outcome prediction. Without such a continuous evaluation, users may be unaware of the performance of predictive models, resulting in inaccurate and misleading predictions. This paper fills this gap by proposing a framework for evaluating online process outcome predictions, comprising two different evaluation methods. These methods are partly inspired by the literature on streaming classification with delayed labels and complement each other to provide a comprehensive evaluation of process monitoring techniques: one focuses on real-time performance evaluation, i.e., evaluating the performance of the most recent predictions, whereas the other focuses on progress-based evaluation, i.e., evaluating the ability of a model to output correct predictions at different prefix lengths. We present an evaluation involving three publicly available event logs, including a log characterised by concept drift

Performance Analysis of Emergency Room Episodes Through Process Mining

The performance analysis of Emergency Room episodes is aimed at providing decision makers with knowledge that allows them to decrease waiting times, reduce patient congestion, and improve the quality of care provided. In this case study, Process Mining is used to determine which activities, sub-processes, interactions, and characteristics of episodes explain why some episodes have a longer duration. The employed method and the results obtained are described in detail to serve as a guide for future performance analysis in this domain. It was discovered that the main cause of the increment in the episode duration is the occurrence of a loop between the Examination and Treatment sub-processes. It was also found out that as the episode severity increases, the number of repetitions of the Examination–Treatment loop increases as well. Moreover, the episodes in which this loop is more common are those that lead to Hospitalization as discharge destination. These findings might help to reduce the occurrence of this loop, in turn lowering the episode duration and, consequently, providing faster attention to more patients

Toward Value-Based Healthcare through Interactive Process Mining in Emergency Rooms: The Stroke Case

[EN] The application of Value-based Healthcare requires not only the identification of key processes in the clinical domain but also an adequate analysis of the value chain delivered to the patient. Data Science and Big Data approaches are technologies that enable the creation of accurate systems that model reality. However, classical Data Mining techniques are presented by professionals as black boxes. This evokes a lack of trust in those techniques in the medical domain. Process Mining technologies are human-understandable Data Science tools that can fill this gap to support the application of Value-Based Healthcare in real domains. The aim of this paper is to perform an analysis of the ways in which Process Mining techniques can support health professionals in the application of Value-Based Technologies. For this purpose, we explored these techniques by analyzing emergency processes and applying the critical timing of Stroke treatment and a Question-Driven methodology. To demonstrate the possibilities of Process Mining in the characterization of the emergency process, we used a real log with 9046 emergency episodes from 2145 stroke patients that occurred from January 2010 to June 2017. Our results demonstrate how Process Mining technology can highlight the differences between the flow of stroke patients compared with that of other patients in an emergency. Further, we show that support for health professionals can be provided by improving their understanding of these techniques and enhancing the quality of care.This research was funded by Hospital General de Valencia thanks to the LOPEZ TRIGO 2017 AWARD and by the CONICYT grant REDI 170136 Project. The APC was funded by the APE/2019/007 (D.O.G.V. 8355/06.08.2018 Annex XIII).Ibáñez Sánchez, G.; Fernández Llatas, C.; Martinez-Millana, A.; Celda, A.; Mandingorra, J.; Aparici-Tortajada, L.; Valero Ramon, Z.... (2019). Toward Value-Based Healthcare through Interactive Process Mining in Emergency Rooms: The Stroke Case. International Journal of Environmental research and Public Health. 16(10):1-22. https://doi.org/10.3390/ijerph16101783S1221610Berwick, D. M., Nolan, T. W., & Whittington, J. (2008). The Triple Aim: Care, Health, And Cost. Health Affairs, 27(3), 759-769. doi:10.1377/hlthaff.27.3.759Porter, M. E. (2010). What Is Value in Health Care? New England Journal of Medicine, 363(26), 2477-2481. doi:10.1056/nejmp1011024Mamlin, B. W., & Tierney, W. M. (2016). The Promise of Information and Communication Technology in Healthcare: Extracting Value From the Chaos. The American Journal of the Medical Sciences, 351(1), 59-68. doi:10.1016/j.amjms.2015.10.015Murdoch, T. B., & Detsky, A. S. (2013). The Inevitable Application of Big Data to Health Care. JAMA, 309(13), 1351. doi:10.1001/jama.2013.393Bates, D. W., Saria, S., Ohno-Machado, L., Shah, A., & Escobar, G. (2014). Big Data In Health Care: Using Analytics To Identify And Manage High-Risk And High-Cost Patients. Health Affairs, 33(7), 1123-1131. doi:10.1377/hlthaff.2014.0041Fernández-Llatas, C., Meneu, T., Traver, V., & Benedi, J.-M. (2013). Applying Evidence-Based Medicine in Telehealth: An Interactive Pattern Recognition Approximation. International Journal of Environmental Research and Public Health, 10(11), 5671-5682. doi:10.3390/ijerph10115671Rojas, E., Sepúlveda, M., Munoz-Gama, J., Capurro, D., Traver, V., & Fernandez-Llatas, C. (2017). Question-Driven Methodology for Analyzing Emergency Room Processes Using Process Mining. Applied Sciences, 7(3), 302. doi:10.3390/app7030302Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: what it is and what it isn’t. BMJ, 312(7023), 71-72. doi:10.1136/bmj.312.7023.71Is Evidence-Based Medicine Patient-Centered and Is Patient-Centered Care Evidence-Based? (2006). Health Services Research, 41(1), 1-8. doi:10.1111/j.1475-6773.2006.00504.xGoldberger, J. J., & Buxton, A. E. (2013). Personalized Medicine vs Guideline-Based Medicine. JAMA, 309(24), 2559. doi:10.1001/jama.2013.6629Kelly, M. P., Heath, I., Howick, J., & Greenhalgh, T. (2015). The importance of values in evidence-based medicine. BMC Medical Ethics, 16(1). doi:10.1186/s12910-015-0063-3Gonzalez-Ferrer, A., Seara, G., Cháfer, J., & Mayol, J. (2018). Generating Big Data Sets from Knowledge-based Decision Support Systems to Pursue Value-based Healthcare. International Journal of Interactive Multimedia and Artificial Intelligence, 4(7), 42. doi:10.9781/ijimai.2017.03.006Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014). The Parable of Google Flu: Traps in Big Data Analysis. Science, 343(6176), 1203-1205. doi:10.1126/science.1248506Rojas, E., Munoz-Gama, J., Sepúlveda, M., & Capurro, D. (2016). Process mining in healthcare: A literature review. Journal of Biomedical Informatics, 61, 224-236. doi:10.1016/j.jbi.2016.04.007Fernandez-Llatas, C., Lizondo, A., Monton, E., Benedi, J.-M., & Traver, V. (2015). Process Mining Methodology for Health Process Tracking Using Real-Time Indoor Location Systems. Sensors, 15(12), 29821-29840. doi:10.3390/s151229769Baker, K., Dunwoodie, E., Jones, R. G., Newsham, A., Johnson, O., Price, C. P., … Hall, G. (2017). Process mining routinely collected electronic health records to define real-life clinical pathways during chemotherapy. International Journal of Medical Informatics, 103, 32-41. doi:10.1016/j.ijmedinf.2017.03.011Rebuge, Á., & Ferreira, D. R. (2012). Business process analysis in healthcare environments: A methodology based on process mining. Information Systems, 37(2), 99-116. doi:10.1016/j.is.2011.01.003Partington, A., Wynn, M., Suriadi, S., Ouyang, C., & Karnon, J. (2015). Process Mining for Clinical Processes. ACM Transactions on Management Information Systems, 5(4), 1-18. doi:10.1145/2629446Storm-Versloot, M. N., Ubbink, D. T., Kappelhof, J., & Luitse, J. S. K. (2011). Comparison of an Informally Structured Triage System, the Emergency Severity Index, and the Manchester Triage System to Distinguish Patient Priority in the Emergency Department. Academic Emergency Medicine, 18(8), 822-829. doi:10.1111/j.1553-2712.2011.01122.xFeigin, V. L., Roth, G. A., Naghavi, M., Parmar, P., Krishnamurthi, R., Chugh, S., … Forouzanfar, M. H. (2016). Global burden of stroke and risk factors in 188 countries, during 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. The Lancet Neurology, 15(9), 913-924. doi:10.1016/s1474-4422(16)30073-4Howard, G., & Goff, D. C. (2012). Population shifts and the future of stroke: forecasts of the future burden of stroke. Annals of the New York Academy of Sciences, 1268(1), 14-20. doi:10.1111/j.1749-6632.2012.06665.xGustavsson, A., Svensson, M., Jacobi, F., Allgulander, C., Alonso, J., Beghi, E., … Olesen, J. (2011). Cost of disorders of the brain in Europe 2010. European Neuropsychopharmacology, 21(10), 718-779. doi:10.1016/j.euroneuro.2011.08.008Alberts, M. J. (2000). Recommendations for the Establishment of Primary Stroke Centers. JAMA, 283(23), 3102. doi:10.1001/jama.283.23.3102Conca, T., Saint-Pierre, C., Herskovic, V., Sepúlveda, M., Capurro, D., Prieto, F., & Fernandez-Llatas, C. (2018). Multidisciplinary Collaboration in the Treatment of Patients With Type 2 Diabetes in Primary Care: Analysis Using Process Mining. Journal of Medical Internet Research, 20(4), e127. doi:10.2196/jmir.8884Chavalarias, D., Wallach, J. D., Li, A. H. T., & Ioannidis, J. P. A. (2016). Evolution of ReportingPValues in the Biomedical Literature, 1990-2015. JAMA, 315(11), 1141. doi:10.1001/jama.2016.195

Process mining for healthcare: Characteristics and challenges

[EN] Process mining techniques can be used to analyse business processes using the data logged during their execution. These techniques are leveraged in a wide range of domains, including healthcare, where it focuses mainly on the analysis of diagnostic, treatment, and organisational processes. Despite the huge amount of data generated in hospitals by staff and machinery involved in healthcare processes, there is no evidence of a systematic uptake of process mining beyond targeted case studies in a research context. When developing and using process mining in healthcare, distinguishing characteristics of healthcare processes such as their variability and patient-centred focus require targeted attention. Against this background, the Process-Oriented Data Science in Healthcare Alliance has been established to propagate the research and application of techniques targeting the data-driven improvement of healthcare processes. This paper, an initiative of the alliance, presents the distinguishing characteristics of the healthcare domain that need to be considered to successfully use process mining, as well as open challenges that need to be addressed by the community in the future.This work is partially supported by ANID FONDECYT 1220202, Direccion de Investigacion de la Vicerrectoria de Investigacion de la Pontificia Universidad Catolica de Chile-PUENTE [Grant No. 026/2021] ; and Agencia Nacional de Investigacion y Desarrollo [Grant Nos. ANID-PFCHA/Doctorado Nacional/2019-21190116, ANID-PFCHA/Doctorado Nacional/2020-21201411] . With regard to the co-author Hilda Klasky, this manuscript has been authored by UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the US Department of Energy (DOE) . The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan)Munoz Gama, J.; Martin, N.; Fernández Llatas, C.; Johnson, OA.; Sepúlveda, M.; Helm, E.; Galvez-Yanjari, V.... (2022). Process mining for healthcare: Characteristics and challenges. Journal of Biomedical Informatics. 127:1-15. https://doi.org/10.1016/j.jbi.2022.10399411512

What Role Can Process Mining Play in Recurrent Clinical Guidelines Issues? A Position Paper

[EN] In the age of Evidence-Based Medicine, Clinical Guidelines (CGs) are recognized to be an indispensable tool to support physicians in their daily clinical practice. Medical Informatics is expected to play a relevant role in facilitating diffusion and adoption of CGs. However, the past pioneering approaches, often fragmented in many disciplines, did not lead to solutions that are actually exploited in hospitals. Process Mining for Healthcare (PM4HC) is an emerging discipline gaining the interest of healthcare experts, and seems able to deal with many important issues in representing CGs. In this position paper, we briefly describe the story and the state-of-the-art of CGs, and the efforts and results of the past approaches of medical informatics. Then, we describe PM4HC, and we answer questions like how can PM4HC cope with this challenge? Which role does PM4HC play and which rules should be employed for the PM4HC scientific community?Gatta, R.; Vallati, M.; Fernández Llatas, C.; Martinez-Millana, A.; Orini, S.; Sacchi, L.; Lenkowicz, J.... (2020). What Role Can Process Mining Play in Recurrent Clinical Guidelines Issues? A Position Paper. International Journal of Environmental research and Public Health (Online). 17(18):1-19. https://doi.org/10.3390/ijerph17186616S1191718Guyatt, G. (1992). Evidence-Based Medicine. JAMA, 268(17), 2420. doi:10.1001/jama.1992.03490170092032Hripcsak, G., Ludemann, P., Pryor, T. A., Wigertz, O. B., & Clayton, P. D. (1994). Rationale for the Arden Syntax. Computers and Biomedical Research, 27(4), 291-324. doi:10.1006/cbmr.1994.1023Peleg, M. (2013). Computer-interpretable clinical guidelines: A methodological review. Journal of Biomedical Informatics, 46(4), 744-763. doi:10.1016/j.jbi.2013.06.009Van de Velde, S., Heselmans, A., Delvaux, N., Brandt, L., Marco-Ruiz, L., Spitaels, D., … Flottorp, S. (2018). A systematic review of trials evaluating success factors of interventions with computerised clinical decision support. Implementation Science, 13(1). doi:10.1186/s13012-018-0790-1Rawson, T. M., Moore, L. S. P., Hernandez, B., Charani, E., Castro-Sanchez, E., Herrero, P., … Holmes, A. H. (2017). A systematic review of clinical decision support systems for antimicrobial management: are we failing to investigate these interventions appropriately? Clinical Microbiology and Infection, 23(8), 524-532. doi:10.1016/j.cmi.2017.02.028Greenes, R. A., Bates, D. W., Kawamoto, K., Middleton, B., Osheroff, J., & Shahar, Y. (2018). Clinical decision support models and frameworks: Seeking to address research issues underlying implementation successes and failures. Journal of Biomedical Informatics, 78, 134-143. doi:10.1016/j.jbi.2017.12.005Garcia, C. dos S., Meincheim, A., Faria Junior, E. R., Dallagassa, M. R., Sato, D. M. V., Carvalho, D. R., … Scalabrin, E. E. (2019). Process mining techniques and applications – A systematic mapping study. Expert Systems with Applications, 133, 260-295. doi:10.1016/j.eswa.2019.05.003Bhargava, A., Kim, T., Quine, D. B., & Hauser, R. G. (2019). A 20-Year Evaluation of LOINC in the United States’ Largest Integrated Health System. Archives of Pathology & Laboratory Medicine, 144(4), 478-484. doi:10.5858/arpa.2019-0055-oaLee, D., de Keizer, N., Lau, F., & Cornet, R. (2014). Literature review of SNOMED CT use. Journal of the American Medical Informatics Association, 21(e1), e11-e19. doi:10.1136/amiajnl-2013-001636TROTTI, A., COLEVAS, A., SETSER, A., RUSCH, V., JAQUES, D., BUDACH, V., … COLEMAN, C. (2003). CTCAE v3.0: development of a comprehensive grading system for the adverse effects of cancer treatment. Seminars in Radiation Oncology, 13(3), 176-181. doi:10.1016/s1053-4296(03)00031-6Daniel, C., & Kalra, D. (2019). Clinical Research Informatics: Contributions from 2018. Yearbook of Medical Informatics, 28(01), 203-205. doi:10.1055/s-0039-1677921Marco-Ruiz, L., Pedrinaci, C., Maldonado, J. A., Panziera, L., Chen, R., & Bellika, J. G. (2016). Publication, discovery and interoperability of Clinical Decision Support Systems: A Linked Data approach. Journal of Biomedical Informatics, 62, 243-264. doi:10.1016/j.jbi.2016.07.011Marcos, C., González-Ferrer, A., Peleg, M., & Cavero, C. (2015). Solving the interoperability challenge of a distributed complex patient guidance system: a data integrator based on HL7’s Virtual Medical Record standard. Journal of the American Medical Informatics Association, 22(3), 587-599. doi:10.1093/jamia/ocv003Wulff, A., Haarbrandt, B., Tute, E., Marschollek, M., Beerbaum, P., & Jack, T. (2018). An interoperable clinical decision-support system for early detection of SIRS in pediatric intensive care using openEHR. Artificial Intelligence in Medicine, 89, 10-23. doi:10.1016/j.artmed.2018.04.012Chen, C., Chen, K., Hsu, C.-Y., Chiu, W.-T., & Li, Y.-C. (Jack). (2010). A guideline-based decision support for pharmacological treatment can improve the quality of hyperlipidemia management. Computer Methods and Programs in Biomedicine, 97(3), 280-285. doi:10.1016/j.cmpb.2009.12.004Anani, N., Mazya, M. V., Chen, R., Prazeres Moreira, T., Bill, O., Ahmed, N., … Koch, S. (2017). Applying openEHR’s Guideline Definition Language to the SITS international stroke treatment registry: a European retrospective observational study. BMC Medical Informatics and Decision Making, 17(1). doi:10.1186/s12911-016-0401-5Eddy, D. M. (1982). Clinical Policies and the Quality of Clinical Practice. New England Journal of Medicine, 307(6), 343-347. doi:10.1056/nejm198208053070604Guyatt, G. H. (1990). Then-of-1 Randomized Controlled Trial: Clinical Usefulness. Annals of Internal Medicine, 112(4), 293. doi:10.7326/0003-4819-112-4-293CHALMERS, I. (1993). The Cochrane Collaboration: Preparing, Maintaining, and Disseminating Systematic Reviews of the Effects of Health Care. Annals of the New York Academy of Sciences, 703(1 Doing More Go), 156-165. doi:10.1111/j.1749-6632.1993.tb26345.xWoolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999). Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines. BMJ, 318(7182), 527-530. doi:10.1136/bmj.318.7182.527Grading quality of evidence and strength of recommendations. (2004). BMJ, 328(7454), 1490. doi:10.1136/bmj.328.7454.1490Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008). GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ, 336(7650), 924-926. doi:10.1136/bmj.39489.470347.adHill, J., Bullock, I., & Alderson, P. (2011). A Summary of the Methods That the National Clinical Guideline Centre Uses to Produce Clinical Guidelines for the National Institute for Health and Clinical Excellence. Annals of Internal Medicine, 154(11), 752. doi:10.7326/0003-4819-154-11-201106070-00007Qaseem, A. (2012). Guidelines International Network: Toward International Standards for Clinical Practice Guidelines. Annals of Internal Medicine, 156(7), 525. doi:10.7326/0003-4819-156-7-201204030-00009Rosenfeld, R. M., Nnacheta, L. C., & Corrigan, M. D. (2015). Clinical Consensus Statement Development Manual. Otolaryngology–Head and Neck Surgery, 153(2_suppl), S1-S14. doi:10.1177/0194599815601394De Boeck, K., Castellani, C., & Elborn, J. S. (2014). Medical consensus, guidelines, and position papers: A policy for the ECFS. Journal of Cystic Fibrosis, 13(5), 495-498. doi:10.1016/j.jcf.2014.06.012Clinical Practical Guidelineshttp://www.openclinical.org/guidelines.htmlHaynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A.-H. S., Dellinger, E. P., … Gawande, A. A. (2009). A Surgical Safety Checklist to Reduce Morbidity and Mortality in a Global Population. New England Journal of Medicine, 360(5), 491-499. doi:10.1056/nejmsa0810119Grigg, E. (2015). Smarter Clinical Checklists. Anesthesia & Analgesia, 121(2), 570-573. doi:10.1213/ane.0000000000000352Hales, B., Terblanche, M., Fowler, R., & Sibbald, W. (2007). Development of medical checklists for improved quality of patient care. International Journal for Quality in Health Care, 20(1), 22-30. doi:10.1093/intqhc/mzm062Greenfield, S. (2017). Clinical Practice Guidelines. JAMA, 317(6), 594. doi:10.1001/jama.2016.19969Vegting, I. L., van Beneden, M., Kramer, M. H. H., Thijs, A., Kostense, P. J., & Nanayakkara, P. W. B. (2012). How to save costs by reducing unnecessary testing: Lean thinking in clinical practice. European Journal of Internal Medicine, 23(1), 70-75. doi:10.1016/j.ejim.2011.07.003Drummond, M. (2016). Clinical Guidelines: A NICE Way to Introduce Cost-Effectiveness Considerations? Value in Health, 19(5), 525-530. doi:10.1016/j.jval.2016.04.020Prior, M., Guerin, M., & Grimmer-Somers, K. (2008). The effectiveness of clinical guideline implementation strategies - a synthesis of systematic review findings. Journal of Evaluation in Clinical Practice, 14(5), 888-897. doi:10.1111/j.1365-2753.2008.01014.xWatts, C. G., Dieng, M., Morton, R. L., Mann, G. J., Menzies, S. W., & Cust, A. E. (2014). Clinical practice guidelines for identification, screening and follow-up of individuals at high risk of primary cutaneous melanoma: a systematic review. British Journal of Dermatology, 172(1), 33-47. doi:10.1111/bjd.13403Woolf, S., Schünemann, H. J., Eccles, M. P., Grimshaw, J. M., & Shekelle, P. (2012). Developing clinical practice guidelines: types of evidence and outcomes; values and economics, synthesis, grading, and presentation and deriving recommendations. Implementation Science, 7(1). doi:10.1186/1748-5908-7-61Legido-Quigley, H., Panteli, D., Brusamento, S., Knai, C., Saliba, V., Turk, E., … Busse, R. (2012). Clinical guidelines in the European Union: Mapping the regulatory basis, development, quality control, implementation and evaluation across member states. Health Policy, 107(2-3), 146-156. doi:10.1016/j.healthpol.2012.08.004Rashidian, A., Eccles, M. P., & Russell, I. (2008). Falling on stony ground? A qualitative study of implementation of clinical guidelines’ prescribing recommendations in primary care. Health Policy, 85(2), 148-161. doi:10.1016/j.healthpol.2007.07.011Yang, W.-S., & Hwang, S.-Y. (2006). A process-mining framework for the detection of healthcare fraud and abuse. Expert Systems with Applications, 31(1), 56-68. doi:10.1016/j.eswa.2005.09.003Kose, I., Gokturk, M., & Kilic, K. (2015). An interactive machine-learning-based electronic fraud and abuse detection system in healthcare insurance. Applied Soft Computing, 36, 283-299. doi:10.1016/j.asoc.2015.07.018Pryor, T. A., Gardner, R. M., Clayton, P. D., & Warner, H. R. (1983). The HELP system. Journal of Medical Systems, 7(2), 87-102. doi:10.1007/bf00995116Shahar, Y., Miksch, S., & Johnson, P. (1998). The Asgaard project: a task-specific framework for the application and critiquing of time-oriented clinical guidelines. Artificial Intelligence in Medicine, 14(1-2), 29-51. doi:10.1016/s0933-3657(98)00015-3Boxwala, A. A., Peleg, M., Tu, S., Ogunyemi, O., Zeng, Q. T., Wang, D., … Shortliffe, E. H. (2004). GLIF3: a representation format for sharable computer-interpretable clinical practice guidelines. Journal of Biomedical Informatics, 37(3), 147-161. doi:10.1016/j.jbi.2004.04.002Terenziani, P., Molino, G., & Torchio, M. (2001). A modular approach for representing and executing clinical guidelines. Artificial Intelligence in Medicine, 23(3), 249-276. doi:10.1016/s0933-3657(01)00087-2Sutton, D. R., & Fox, J. (2003). The Syntax and Semantics of the PROformaGuideline Modeling Language. Journal of the American Medical Informatics Association, 10(5), 433-443. doi:10.1197/jamia.m1264Musen, M. A., Tu, S. W., Das, A. K., & Shahar, Y. (1996). EON: A Component-Based Approach to Automation of Protocol-Directed Therapy. Journal of the American Medical Informatics Association, 3(6), 367-388. doi:10.1136/jamia.1996.97084511Ciccarese, P., Caffi, E., Quaglini, S., & Stefanelli, M. (2005). Architectures and tools for innovative Health Information Systems: The Guide Project. International Journal of Medical Informatics, 74(7-8), 553-562. doi:10.1016/j.ijmedinf.2005.02.001Shiffman, R. N., & Greenes, R. A. (1994). Improving Clinical Guidelines with Logic and Decision-table Techniques. Medical Decision Making, 14(3), 245-254. doi:10.1177/0272989x9401400306Peleg, M., Tu, S., Bury, J., Ciccarese, P., Fox, J., Greenes, R. A., … Stefanelli, M. (2003). Comparing Computer-interpretable Guideline Models: A Case-study Approach. Journal of the American Medical Informatics Association, 10(1), 52-68. doi:10.1197/jamia.m1135Karadimas, H., Ebrahiminia, V., & Lepage, E. (2018). User-defined functions in the Arden Syntax: An extension proposal. Artificial Intelligence in Medicine, 92, 103-110. doi:10.1016/j.artmed.2015.11.003Peleg, M., Keren, S., & Denekamp, Y. (2008). Mapping computerized clinical guidelines to electronic medical records: Knowledge-data ontological mapper (KDOM). Journal of Biomedical Informatics, 41(1), 180-201. doi:10.1016/j.jbi.2007.05.003German, E., Leibowitz, A., & Shahar, Y. (2009). An architecture for linking medical decision-support applications to clinical databases and its evaluation. Journal of Biomedical Informatics, 42(2), 203-218. doi:10.1016/j.jbi.2008.10.007Marcos, M., Maldonado, J. A., Martínez-Salvador, B., Boscá, D., & Robles, M. (2013). Interoperability of clinical decision-support systems and electronic health records using archetypes: A case study in clinical trial eligibility. Journal of Biomedical Informatics, 46(4), 676-689. doi:10.1016/j.jbi.2013.05.004Marco-Ruiz, L., Moner, D., Maldonado, J. A., Kolstrup, N., & Bellika, J. G. (2015). Archetype-based data warehouse environment to enable the reuse of electronic health record data. International Journal of Medical Informatics, 84(9), 702-714. doi:10.1016/j.ijmedinf.2015.05.016Gooch, P., & Roudsari, A. (2011). Computerization of workflows, guidelines, and care pathways: a review of implementation challenges for process-oriented health information systems. Journal of the American Medical Informatics Association, 18(6), 738-748. doi:10.1136/amiajnl-2010-000033Quaglini, S., Stefanelli, M., Cavallini, A., Micieli, G., Fassino, C., & Mossa, C. (2000). Guideline-based careflow systems. Artificial Intelligence in Medicine, 20(1), 5-22. doi:10.1016/s0933-3657(00)00050-6Schadow, G., Russler, D. C., & McDonald, C. J. (2001). Conceptual alignment of electronic health record data with guideline and workflow knowledge. International Journal of Medical Informatics, 64(2-3), 259-274. doi:10.1016/s1386-5056(01)00196-4González-Ferrer, A., ten Teije, A., Fdez-Olivares, J., & Milian, K. (2013). Automated generation of patient-tailored electronic care pathways by translating computer-interpretable guidelines into hierarchical task networks. Artificial Intelligence in Medicine, 57(2), 91-109. doi:10.1016/j.artmed.2012.08.008Shabo, A., Parimbelli, E., Quaglini, S., Napolitano, C., & Peleg, M. (2016). Interplay between Clinical Guidelines and Organizational Workflow Systems. Methods of Information in Medicine, 55(06), 488-494. doi:10.3414/me16-01-0006Mulyar, N., van der Aalst, W. M. P., & Peleg, M. (2007). A Pattern-based Analysis of Clinical Computer-interpretable Guideline Modeling Languages. Journal of the American Medical Informatics Association, 14(6), 781-787. doi:10.1197/jamia.m2389Grando, M. A., Glasspool, D., & Fox, J. (2012). A formal approach to the analysis of clinical computer-interpretable guideline modeling languages. Artificial Intelligence in Medicine, 54(1), 1-13. doi:10.1016/j.artmed.2011.07.001Kaiser, K., & Marcos, M. (2015). Leveraging workflow control patterns in the domain of clinical practice guidelines. BMC Medical Informatics and Decision Making, 16(1). doi:10.1186/s12911-016-0253-zMartínez-Salvador, B., & Marcos, M. (2016). Supporting the Refinement of Clinical Process Models to Computer-Interpretable Guideline Models. Business & Information Systems Engineering, 58(5), 355-366. doi:10.1007/s12599-016-0443-3Decision Model and Notation Version 1.0https://www.omg.org/spec/DMN/1.0Ghasemi, M., & Amyot, D. (2016). Process mining in healthcare: a systematised literature review. International Journal of Electronic Healthcare, 9(1), 60. doi:10.1504/ijeh.2016.078745Rebuge, Á., & Ferreira, D. R. (2012). Business process analysis in healthcare environments: A methodology based on process mining. Information Systems, 37(2), 99-116. doi:10.1016/j.is.2011.01.003Rovani, M., Maggi, F. M., de Leoni, M., & van der Aalst, W. M. P. (2015). Declarative process mining in healthcare. Expert Systems with Applications, 42(23), 9236-9251. doi:10.1016/j.eswa.2015.07.040Rojas, E., Munoz-Gama, J., Sepúlveda, M., & Capurro, D. (2016). Process mining in healthcare: A literature review. Journal of Biomedical Informatics, 61, 224-236. doi:10.1016/j.jbi.2016.04.007Lenkowicz, J., Gatta, R., Masciocchi, C., Casà, C., Cellini, F., Damiani, A., … Valentini, V. (2018). Assessing the conformity to clinical guidelines in oncology. Management Decision, 56(10), 2172-2186. doi:10.1108/md-09-2017-0906Fernández-Llatas, C., Benedi, J.-M., García-Gómez, J., & Traver, V. (2013). Process Mining for Individualized Behavior Modeling Using Wireless Tracking in Nursing Homes. Sensors, 13(11), 15434-15451. doi:10.3390/s131115434Qu, G., Liu, Z., Cui, S., & Tang, J. (2013). Study on Self-Adaptive Clinical Pathway Decision Support System Based on Case-Based Reasoning. Frontier and Future Development of Information Technology in Medicine and Education, 969-978. doi:10.1007/978-94-007-7618-0_95Van de Velde, S., Roshanov, P., Kortteisto, T., Kunnamo, I., Aertgeerts, B., Vandvik, P. O., & Flottorp, S. (2015). Tailoring implementation strategies for evidence-based recommendations using computerised clinical decision support systems: protocol for the development of the GUIDES tools. Implementation Science, 11(1). doi:10.1186/s13012-016-0393-

Active Anomaly Detection for Key Item Selection in Process Auditing

Process mining allows auditors to retrieve crucial information about transactions by analysing the process data of a client. We propose an approach that supports the identification of unusual or unexpected transactions, also referred to as exceptions. These exceptions can be selected by auditors as “key items”, meaning the auditors wants to look further into the underlying documentation of the transaction. The approach encodes the traces, assigns an anomaly score to each trace, and uses the domain knowledge of auditors to update the assigned anomaly scores through active anomaly detection. The approach is evaluated with three groups of auditors over three cycles. The results of the evaluation indicate that the approach has the potential to support the decision-making process of auditors. Although auditors still need to make a manual selection of key items, they are able to better substantiate this selection. As such, our research can be seen as a step forward with respect to the usage of anomaly detection and data analysis in process auditing

Measurement of the cross-section and charge asymmetry of WW bosons produced in proton-proton collisions at s=8\sqrt{s}=8 TeV with the ATLAS detector

This paper presents measurements of the $W^+ \rightarrow \mu^+\nu$ and $W^- \rightarrow \mu^-\nu$ cross-sections and the associated charge asymmetry as a function of the absolute pseudorapidity of the decay muon. The data were collected in proton--proton collisions at a centre-of-mass energy of 8 TeV with the ATLAS experiment at the LHC and correspond to a total integrated luminosity of 20.2~\mbox{fb^{-1}}. The precision of the cross-section measurements varies between 0.8% to 1.5% as a function of the pseudorapidity, excluding the 1.9% uncertainty on the integrated luminosity. The charge asymmetry is measured with an uncertainty between 0.002 and 0.003. The results are compared with predictions based on next-to-next-to-leading-order calculations with various parton distribution functions and have the sensitivity to discriminate between them.Comment: 38 pages in total, author list starting page 22, 5 figures, 4 tables, submitted to EPJC. All figures including auxiliary figures are available at https://atlas.web.cern.ch/Atlas/GROUPS/PHYSICS/PAPERS/STDM-2017-13

Search for new phenomena in final states with an energetic jet and large missing transverse momentum in pp collisions at √ s = 8 TeV with the ATLAS detector

Results of a search for new phenomena in final states with an energetic jet and large missing transverse momentum are reported. The search uses 20.3 fb−1 of √ s = 8 TeV data collected in 2012 with the ATLAS detector at the LHC. Events are required to have at least one jet with pT > 120 GeV and no leptons. Nine signal regions are considered with increasing missing transverse momentum requirements between Emiss T > 150 GeV and Emiss T > 700 GeV. Good agreement is observed between the number of events in data and Standard Model expectations. The results are translated into exclusion limits on models with either large extra spatial dimensions, pair production of weakly interacting dark matter candidates, or production of very light gravitinos in a gauge-mediated supersymmetric model. In addition, limits on the production of an invisibly decaying Higgs-like boson leading to similar topologies in the final state are presente

Search for chargino-neutralino production with mass splittings near the electroweak scale in three-lepton final states in √s=13 TeV pp collisions with the ATLAS detector

A search for supersymmetry through the pair production of electroweakinos with mass splittings near the electroweak scale and decaying via on-shell W and Z bosons is presented for a three-lepton final state. The analyzed proton-proton collision data taken at a center-of-mass energy of √s=13  TeV were collected between 2015 and 2018 by the ATLAS experiment at the Large Hadron Collider, corresponding to an integrated luminosity of 139  fb−1. A search, emulating the recursive jigsaw reconstruction technique with easily reproducible laboratory-frame variables, is performed. The two excesses observed in the 2015–2016 data recursive jigsaw analysis in the low-mass three-lepton phase space are reproduced. Results with the full data set are in agreement with the Standard Model expectations. They are interpreted to set exclusion limits at the 95% confidence level on simplified models of chargino-neutralino pair production for masses up to 345 GeV

Search for dark matter produced in association with bottom or top quarks in √s = 13 TeV pp collisions with the ATLAS detector

A search for weakly interacting massive particle dark matter produced in association with bottom or top quarks is presented. Final states containing third-generation quarks and miss- ing transverse momentum are considered. The analysis uses 36.1 fb−1 of proton–proton collision data recorded by the ATLAS experiment at √s = 13 TeV in 2015 and 2016. No significant excess of events above the estimated backgrounds is observed. The results are in- terpreted in the framework of simplified models of spin-0 dark-matter mediators. For colour- neutral spin-0 mediators produced in association with top quarks and decaying into a pair of dark-matter particles, mediator masses below 50 GeV are excluded assuming a dark-matter candidate mass of 1 GeV and unitary couplings. For scalar and pseudoscalar mediators produced in association with bottom quarks, the search sets limits on the production cross- section of 300 times the predicted rate for mediators with masses between 10 and 50 GeV and assuming a dark-matter mass of 1 GeV and unitary coupling. Constraints on colour- charged scalar simplified models are also presented. Assuming a dark-matter particle mass of 35 GeV, mediator particles with mass below 1.1 TeV are excluded for couplings yielding a dark-matter relic density consistent with measurements